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Abstract 

In this paper we present the exact value for the norm of directional 
derivatives, of all orders, for symmetric tensor powers of operators on 
finite dimensional vector spaces. Using this result we obtain an upper 
bound for the norm of all directional derivatives of immanants. 

This work is inspired in results by R. Bhatia, J. Dias da Silva, P. 
Grover and T. Jain. 



1 Introduction 

Let V and U be finite-dimensional complex vector spaces, and denote by 
C{V) the vector space of linear operators from V to itself. The fc-th derivative 
of a map f : V U is a multilinear map D'^f{T) from [CiV))^ to C{U) 
defined as 



D^f{T){X\...,X^) 



d 



dti . . .dtk 



=u=o 



f{T + hX^ + ...+tkX''). 
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The norm of a multilinear operator $ : {C{V)) — > ^{U) is given by 

ii$ii= sup mx\...,x')\\. 

||Xi||=...=||X'=||=l 

We will obtain exact values for the norm of /c-th derivative of the operator 
/(T) = K^{T), where K^{T) represents the x-symmetric tensor power of the 
operator T, that is, the restriction of the operator (8)™T to the subspace of 
X-symmetric tensors, which we will denote by V^. 

Let z/i, . . . , i/„ be the singular values of the operator T and denote by the 
symmetric polynomial of degree t (the number of variables to be specified). 
In the papers ^lOj, [9j and |6] the following values were obtained: 

(m — k)\ (m — k)\ ^ 

\\D' A™T|| =fc!p^_fc(z/i,...,i/^). 

On the other hand, R. Bhatia and J. Dias da Silva established in |1] a 
formula for the norm of the first derivative of the x-symmetric tensor power 
of an operator. It is again k\ times of the value of the elementary symmetric 
polynomial of degree m — 1 taken on m singular values of the operator T. 
In all cases, we note that the norm is the value of the elementary symmetric 
polynomial of degree m — k applied to a certain family of m singular values 
of T (eventually with repetitions), multiplied by k\. 

In this paper we will present a result that generalizes all these cases. We 
use techniques developed in [B] and [3] and a result from [5]. 



2 Results on x-symmetric tensor powers 

We now present some classic facts and notation about x-synmietric powers 
that can be found in [HI chapter 6]. Let Sm be the symmetric group of 
degree m, x an irreducible character of and define G £((g)™V") as 

where id stands for the identity element of Sm and P{a){yi ® . . . ® Vm) = 
■^0-1(1) ® . . . ® Va-i(m)- The range of is called the symmetry class of 
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tensors associated with the irreducible character x ^-nd it is represented by 
= K^i^'^V). We denote 

Vi*V2* ...*Vm = K^{Vi (g) ® . . . ® Vm)- 

These vectors belong to and are called decomposable symmetrised tensors. 

Given T G JC{V), it is known that is an invariant subspace for ®"^T. 
We define the x-'^ywimeinc tensor power of T as the restriction of <^"^T to 
V-^, and denote it by Ky^{T). 

Let be the set of all maps from the set {!,..., m} into the set 

{1, . . . , n}. This set can also be identified with the collection of multiindices 

{(ii, . . . ,i„J : ij < n}. If a G Tm^n, this correspondence associates to a the 
m-tuple (a(l), . . . , a{m)). In the set Tm,n we will consider the lexicographic 
order. The g roup SiYi &cts on Tm,n by the action [a, a) — > aa ^ where 
a G 5"^ and a G r^ „. The set 

{aa : a G 5"^} C „ 

is then the orbit of a and the stabilizer of a is the following subgroup of 3^: 

Ga = {c G Sjn '■ oca — a}. 

Let {ci, . . . , e„} be an orthonormal basis of the vector space V. Then 

{e® = ® ea(2) ... ea{m) ■ ot G r^,„} 

is a basis of the m-th tensor power of V. So, by the definition of the space 
the set 

{el = K^{et) : a G r^,„} 

spans V^. However, this set need not be a basis of V^, because its elements 
might not be linearly independent, some of them may even be zero. Let 

Q = = {a G Tm,n : J] x(f^) 0}. (1) 
With simple calculations, we can conclude that 

IKII^ = #ExW- P) 
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So the nonzero decomposable symmetrised tensors are {e* : a ^ Q}. Now, 
let A be the system of distinct representatives for the quocient set Tm,n/Sm, 
constructed by choosing the first element in each orbit, for the lexicographic 
order of indices. It is easy to check that A C Gm,n, where Gm,n is the set of 
all increasing sequences of r^_„. Let 

A = Ano. 

It can be proved that the set {e* : a e A} is hnearly independent. We have 
already seen that the set {e* : a e fi}, spans V^, so there is a set A, such 
that A C A C n and 

{el-.ae A}, (3) 

is a basis for Vy.. It is also known that this basis is orthogonal if x is a linear 
character. If x is the principal character, A = A = Gm,n and if x is the 
alternating character, A = A = Qm,n- In both cases the corresponding bases 
are orthogonal. 

A partition tt of m is an r-tuple of positive integers tt = (tti, . . . , tt^), such 
that 

• TTl > . . . > TTr, 

• TTi + . . . + TTr — m. 

Sometimes it is useful to consider a partition of m with exactly m entries, 
so we complete the list with zeros. The number of nonzero entries in the 
partition tt is called the length of n and is represented by /(tt). 

Given an n-tuple of real numbers x = {xi, . . . ,Xn) and a e Tm,n, we 
define the m-tuple 

Xqi . ; •^a(2) ; • • • ; •^a{m) ) • 

It is known from representation theory that there is a canonical corre- 
spondence between the irreducible characters of Sm and the partitions of 
m, it is usual to use the same notation to represent both of them. Re- 
call that if X = (Ij • • • J 1) then Vy^ — A"^V is the Grassmann space, and if 
X = (m, . . . , 0), then = V™\/. 

For every partition n = (tti, 712, ■ ■ ■ , 7r;(7r)) of m we define 00(11) as 

uj{n) := {1^_^,2^_^, . . . , l{n),. l{n)) e C r^,„. 

TTi times TV2 times 7rj(^) times 
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For each a G Tm,n let Ima = {zi, . . . suppose that \a > • • • > 

The partition of m 

^^{a) := {\a-\i,)l . . . ,\a-\ii)\) (4) 

is called the multiplicity partition of a. 

Remark 2.1. The multiplicity partition of ^(vr) is equal to the partition vr: 
/i(w(7r)) = vr. 

We have that Imu;(7r) = {1, 2, . . . , /(vr)} and that |a;^^(2)| = TTj, for every 
i = l,2,.../(7r). So 

/i(u;(7r)) = (|a-^(l)|, |a-^(2)|, . . . , |a-^(/(7r))|) = {n,, ir^, . . . , 7r,(^)) = vr. 

We recall a well known order defined on the set of partitions of m. A 
partition /i precedes A, written /i ^ A, if for all 1 < s < m, 

s s 
3=1 3=1 

We will also need the following classical result, which is flT^, Th. 6.3.7]. 

Theorem 2.2. Let x be a partition of m and a G Tm,n- Let VL^ and fi{a) be 
as defined in ([7]j and Then a & if and only if x majorizes fi{a). 



3 Formulas on k-th derivatives 

We now present a formula for higher order derivatives that generalizes for- 
mulas in [5] and [6]. It is known that, given X^, . . . ,X"^ G C{V), the space 
is invariant for the map defined as 

X^^X^^ . . . ^X™ := ^ y X"(^) ® • ■ ■ ® X"("^). 

See for instance pTl, p. 184]. We will denote by the restriction of this map to 
by X^ * ■ ■ ■ * X^ and call it the symmetrized x-symmetric tensor product 
of the operators X^, . . . , X™'. We remark that this notation does not convey 
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the fact that the product depends on the character x- IS] the following 
formula is deduced: 

D\(^'^T){X\...,X^) = ^^^^ '^^^^. T^- . -^T ^X^^-.-^X'. (5) 

m—k copies 

If A; > m all derivatives are zero. From this we can deduce a formula for 
D^K^(T){X^ , . . . , X'^), using the same techniques. 

If L is a linear map, it is known that the derivative of L is L at each 
point. Then, applying the chain rule, we have that 

D{Lof){a)ix) = LoD{fia){x)). 

If the map f is k times different iable then 

D\L o f)ia)ix\ ...,x^) = Lo D'^f{a){x\ . . . , x^). (6) 

Theorem 3.1. Using the notation we have established, we have 

Til ^ 

D^KJT){X\...,X^) = —T*---*T*XU---*XK 

{m — ky. 

If m = k this formula does not depend on T , and if k > m all derivatives are 
zero. 

Proof. Let Q be the inclusion map defined as Q : — > (8)™V", so its adjoint 
operator Q* is the projection of ®™V" onto V^. We have 

Ti*---*T„ = Q*(Ti®---®T^)Q. 

Both maps L Q*T and T i— )■ LQ are linear, so we can apply formulas ([3]) 
and ([6]) and get 

D'=ir^(T)(Xi,...,X") = D\Q*{^"'T)Q){X\...,X'') 

= Q*D\(^"'T){X\...,X^)Q 



mi 



g*(r®---®T®x^®---®x'=)g 



{m — k)\ 

m—k times 

777 ^ 

■ -T*---*r*x^*---*x*^. 



{m — k)\ 

This concludes the proof. □ 
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4 Norm of the A:-the derivative of K^(T) 

We recall that the norm of a multilinear operator $ : {C{y)Y — > ^{U) is 
given by 

ii$ii= sup mx\...,x^)\\. 

||Xi|| = ...=||X'=|l=l 

The main result of this section is the following theorem. 

Theorem 4.1. Let V he an n- dimensional Hilbert space. Let m and k be 
positive integers such that 1 < k < m < n, and let x a partition of m. Let 
T — )■ K^{T) he the map that associates to each element of C{V) the induced 
operator K^{T) on the symmetry class V^. Then the norm of the derivative 
of order k of this map is given by the formula 

||D'=ir^(T)|| = fc!p„_fc(z/^(^)) (7) 

where Pm-k is the symmetric polynomial of degree m — k in m variables. 

The proof of our main result is inspired in the techniques used in [1]. 
We will now highlight the most important features of the proof of our main 
theorem. 

First we will use the polar decomposition of the operator T, in the fol- 
lowing form: P = TW, with P positive semidefinite and W unitary. We will 
see that \\D''K^{T)\\ = \\D''K^{P)\\. This allows us to replace T by P. After 
that we observe that the multilinear map D^K^{P) is positive between the 
two algebras in question, so it is possible to use a multilinear version of the 
famous Russo-Dye theorem that states that the norm for a positive multi- 
linear map is attained in {1,1, ... ,1), where / is the identity operator. This 
result considerably simplifies the calculations needed to obtain the expression 
stated in our theorem. 

The second part of our proof consists in finding the largest singular 
value of D'^K^[P)[I , !,...,!), which coincides with the value of the norm of 
D'K^iT). 

First we will need some properties of the operator K^. They all follow 
from the definitions. 
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Proposition 4.2. Let x be an irreducible character of and suppose that 
S and T are in CiV) and Vi, . . .Vm € V. Then 

1. K^(ST) = K^(S)K^(T), 

2. K^{T){vi *...*vj^ T{vi) * • • • * T{vm), 

3. K^{T)* = K^{T*), where T* is the adjoint operator of T , 

4- K^{T) is invertible for all invertible T and K^(T)~^ = K^(T~^). 

By the polar decomposition, we know that for every T G C{V) there 
are a positive semidefinite operator P and an unitary operator W such that 
P = TW. Moreover, the eigenvalues of P are the singular values of T. 

Proposition 4.3. With the above notation, we have 

\\D'K^iT)\\ = \\D'K^iP)\\. 

Proof. Let P — TW, with W unitary. Then K-)^{W) is also unitary , because 

[K^iW]]-' = K^{W-') = K^iW*) = [K^{W)r . 

So, we have 

\\D'K^{T)(X\...,X')\\^ 

\D'^K^iT)iX\...,X')K^iW)\\ 



d" 



dti... dtk 

Qm 



K^{T + t^X' 



t.X'^) K^{W)\\ 



dti... dtk 

gm 



tl= 



ti=...=tk=0 

K^(T + tiX^ + ... + tkX')K^{W) II 



dti... dtk 



K^{P + tiX^W + . . . + tkX^W) II 



\D^K,,{P){X^W,...,X^W)\\ 

We have ||XW|| = ||X*|| and moreover {XW : \\X\\ = 1} is the set of all 
operators of norm 1, so 



sup 

||Xi||=...=||X'=||=l 



sup 

||Xi||=...=||X*=||=l 

\\D'K^{P)\\. 



D'K^{T){X\...,X')\\ 
D''K^{P)(X^W,...,X''W)\\ 



This concludes the proof. 



□ 
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Now we need to estimate the norm of the operator D^K^{P). For this, 
we use a result from [S], a multihnear version of the Russo-Dye theorem, 
which we quote here. A multihnear operator $ is said to be positive if 
. . . , X'^) is a positive semidefinite operator whenever X^, . . . , X'' are 

so. 

Theorem 4.4 (Russo-Dye multilinear version). Let $ : C{V)'' — > ^{U) he 
a positive multilinear operator. Then 

||$|| = ||$(/,/,...,/)||. 

We have that D''K^{P) is a positive multilinear operator, since if X^, . . . , X^ 
are positive semidefinite, then by the formula in Theorem 13. ![ D''{P){X^ , . . . , X^) 
is the restriction of a positive semidefinite operator to an invariant subspace, 
and thus is positive semidefinite. 

Therefore, 

\\D'K^{T)\\ = \\D'^K^{P)\\ = \\D'K^{P){I,I,...,I)\\. 

Now we have to find the maximum eigenvalue of the operator D'^K^{P) (/, /, . . 
This will be done by finding a basis of Vy. formed by eigenvectors for D'^K^{P) (J, J, 
li E = {ei,...,e„} is an orthonormal basis of eigenvectors for P, then 
{e* : a G A} will be a basis of eigenvectors for D^K^{P){I , I , . . . , I) (in 
general, it will not be orthonormal). 

For /3 G Qm-k,k, define (8)™P as the tensor (g) ■ ■ ■ ® X™-, in which 
X* = P if i G Im P and X* = / otherwise. 

Lemma 4.5. We refer to the notation we have established so far. 
1. We have 

k\{m — k)\ 




ml 

f^£Qm-k,k 



2. Let Vi, . . . ,Vm be eigenvectors for P with eigenvalues Ai, . . . , Xm- Then 

'S)fP{Vi ■ ■ ■ IS) Vm) = Pm-fc(Ai, . . . , \m)Vl ® . . . ® f m 

1^ m — k ,m 
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Proof. 1. It is a matter of carrying out the computations. The factors k\ 
and (m — A;)! account for the permutations of / and P, respectively, in each 
summand. We note that the final factor is exactly the inverse of the number 
of summands, as in the definition of • • • • • • ®/. 

2. For each /3 e Qm-k,m we have that 

m—k 

i=l 

So, 

m—k 

= Pm-k{>^l: ■ ■ ■ Am)Vl ® . . . ® Vm- 

This concludes the proof. □ 

The following proposition gives the expression for the eigenvalues of D''K^{P) (/, /, . 

Proposition 4.6. Let a e A. and define 

X{a) := k\pm-k{i^a)- 

Then \{a) is the eigenvalue of K^{P){I , I, . . . ,1) associated with the eigen- 
vector e* . 

Proof. Recall that E — {ci, . . . , e„} is an orthonormal basis of eigenvectors 
for P, with eigenvalues ui, . . . For every a e rm,n we have 
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Then 



D^K^(P) (/,..., /)(e:) = ^__^(P®...®P®/®...®/)(e:) 



m! k\{m — A;)! 



(m — A;)! ml 

^ m — k ,m 



CreSm P^Qm~k,m 

m—kKyaa j^nu 



= k\prn-k{l^a)ea 

In the last equations we used the previous lemma and the symmetry of the 
polynomial Pm-k- So the eigenvalue associated with e* is A (a). □ 

We have obtained the expression for all the eigenvalues of the operator 
D^K^{P){I , . . . , J), now we have to find the largest one. 

Lemma 4.7. If a and /3 are in the same orbit, then \{a) = A(/3). 

Proof. If a and /3 are in the same orbit, then there is cr G Sm such that 
aa = p. So by the definition of the symmetric elementary polynomials, we 
have 

Prn-kiyp) =Pm-k{Vaa) =Pm-k{yo). 

This concludes the proof. □ 



According to [TT], every orbit has a representative in Gm,n, and this is the 
first element in each orbit (for the lexicographic order). Therefore, the norm 
of the fc-th derivative of K^[T) is attained at some A (a) with a G A C Gm,n- 
We now compare eigenvalues coming from different elements of A. 

Lemma 4.8. Let a,/3 be elements of A C Gm,n- Then X{a) > A(/3) if and 
only if a precedes (3 in the lexicographic order. 

Proof. The result follows directly from the expression of the eigenvalues of 
K^{P){I , ...,/) given in Proposition 14.61 □ 
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We are now ready to complete the proof of the main theorem. From now 
on we will also write x to represent also the partition of m associated with 
the irreducible character x- 

Proof, (of Theorem I4.ip . We have that G A, so we must have 

\\D'K^{P){I,...J)\\>\{u{x)). 

Now let a G A. Using the results from Theorem [22] and Remark |2. 11 we have 
that X = f^i^ix)) majorizes fi{a). By the definition of multiplicity partition, 
we have that uj{x) precedes a in the lexicographic order. By Lemma [4. 8[ we 
then have X{u{x)) > ^{ct) and 

\\D'K^iT)\\ = \\D'K^iP)iI,...,I)\\ = Xiujix)) = k\pm-kiiy.i^)). 
This concludes the proof of the theorem. □ 

Now we will see that the formulas obtained by Jain and Grover [5] 
are particular cases of this last formula. 

If X = 0, ■ ■ ■ ,0) then K^{T) = V™T. In this case i^uiix) = {^ly ■ ■ ■ 
So we have 

||D'=V™T|| = fcW-,.(z/^^)) 

= k\pm-k{l^l,l^l, . . . 



ml 



{m — k)\ 



IT 



I m—k 



Also, if X = (1, 1, ■ ■ ■ , 1), then K^{T) = A"T and z/^(x) = (z/i, 1^2, ■ ■ ■ , I'm)- 
In this case we have that 

A™T|| = A;!p™_fc(z/i,z/2,--- ^Um), 

where pm-ki^i, J^2, ■ ■ ■ , J^m) is the symmetric elementary polynomial of degree 
m — k calculated on the top m singular values of T. 

Our main formula also generalizes the result for the norm of the first 
derivative of K^{T) obtained by R. Bhatia and J. Dias da Silva in Just 



12 



notice that if k 



1, we have that Qi, 



,m 



{1,2 



, ■■■ ,m}, so 



m 



m 




5 Norm of the k-th derivative of the immanant 

We now wish to estabhsh an upper bound for the k-th derivative of the 
immanant, which is defined as 



where A is a complex n x n matrix. For this, we recall the definition of 
K^{A), the m-th x-symmetric tensor power of the matrix A. We find this 
definition in |8], along with other results we will now use. 

A natural way to define this matrix is to fix an orthonormal basis E in 
V, and consider the linear endomorphism T such that A = M{T, E). Define 

= (e* : a G A). Let S = {va : a G A) be the orthonormal basis of the 
m-th x-symmetric tensor power of the vector space V obtained by applying 
the Gram-Schmidt orthonormalization procedure to S'. We define 



The matrix K^{A) has rows and columns indexed in A, with Qm,n ^ A. 
This definition admits, as special cases, the m-th compound and the m-th 
induced power of a matrix, as defined in [TT], p. 236]. 

Since the basis chosen in is orthonormal, the result for the norm of 
the operator apphes to this matrix: 



where z^i > • • • > z^n are the singular values of A. This upper bound is what 
we will need for the main result in this section. 



n 




K^{A) := M{K^{T),S) 



K^{A)\\ <k\p^^.k 
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Before that, we present an explicit formula for K^{A), from [S], and show 
a similarity between the formulas for D''K^{T), obtained in Theorem 13. 
and for D''K^{A), obtained in [8]. 

Denote by imm^(A) the square matrix with rows and columns indexed 
by A, whose (7, 6) entry is (i^(A[7|(5]). Let B = ipap) be the change of basis 
matrix from £ to £' . This means that for each a G A, 

Vet ^ ^ ^7^6^ ■ 

This matrix B does not depend on the choice of the basis E as long as it is 
orthonormal (it encodes the Gram-Schmidt procedure applied to £'). 
With these matrices, we can write 

KM) = ^B*imm^{A)B. (8) 
The mixed immanant of X^, . . . , X" is defined as 

where denotes the j-th column of the matrix X*. If = . . . = X* = 
A, for some t < n and A G M„(C), we denote the mixed immanant by 
A^(A;X*+i,...,X"). 

Denote by miximm^(X^, . . . , X") the square matrix with rows and columns 
indexed by A, whose (7, 5) entry is A;i(,(X^[7|5], . . . , X"[7|5]), so that miximm^(y4 
imm-^(y4). We use the same shorthand as with the mixed immanant: for 
k <n, 

niiximm^(y4; X\ . . . , X'') := miximm^(A, . . . , A, X\ . . . X'') 
We have 

D^KJA){X\...,X^) = R*miximmyM;X\...,X^)E 

^ {m-k)\ XV ' ' ' / 

Notice the similarity with the formula in Theorem 13.11 In fact, if X* is 
the matrix of the operator 5" G C{V) with respect to the orthonormal basis 
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{ei, . . . , Cn}, then the previous matrix is the matrix of D^K^{T){S^, . . . , S^) 
with respect to the basis £. 

We now use the results on the norm in order to get an upper bound for 
the norm of the k-th derivative of the immanant. 

Theorem 5.1. Keeping with the notation established, we have that, for k < 
n, 

\\D''d^{A)\\ < klpn^kiiyco^x)) 

Proof. We always have Q.m,n ^ A. We now take m = n and denote 7 := 
[1,2, ... ,n) G Qn,n ^ A (this is the only element in Qn,n)- By definition, 
d^{A) is the (7,7) entry of imm^(74), and, according to formula ([8]), we have 

Tl ' 

Since multiplication by a constant matrix is a linear map, we have 
D\{B*)-^K^{A)B-^){X\ . . . , X^) = {B*)-^D''K^{A){X\ X'')B-\ 
We denote by C the column 7 of the matrix B^^: 
C = iB-\^ = {b:^), aeA. 

Then 

71 ^ 

By formula ([2]), we have that 

II *||2 ^ X(id) 
HSII ^, • 

By definition of the matrix B, we have 



5Z ^^7^/3 

/3eA 



with C = [b'a : /3 E A]. Since the basis (Va : a G A) is orthonormal, we have 



l^ll ~ 11^112 ~ 11^7 



2 II * 1,2 



n! 
15 



where ||C||2 is the Euchdean norm of C. Therefore, 



WdAA)\\ = ^^\\CD'K^iA)C*\\ 

< _||Cf||Z,^A-,(^)|| 

= fc!p„_fc(z/^(^)). 

This concludes the proof. □ 

In [7] it is proved that this upper bound coincides with the norm of the 
derivative of the determinant. In [6], when = per, the upper bound 
presented in formula (52) is, using our notation, {n\/{n — A;)!)||y4||"~'^. Using 
our formula, we get the same value: for uj{x) = (l? 1; • • • ? 1); 

^ ^ ,n~k _ II 4 ||n-fc 



It is also shown that for 

'1 



A 







we have strict inequality, for = per. 

One of the purposes of having upper bounds for norms is the possibility 
of estimating the magnitude of perturbations. Taylor's formula states that 
if / is a p times differentiable function between two normed spaces, then 

/(a + x)- f{a) = J2 l^D'fia){x, ...,x) + 0{\\x\r'). 



kV 

k=l 



Therefore, 



\\f{a + x)-f{a)\\<j2hD'f\a)\\\\x 



k\ 

k=l 



Using our formulas, we get the following result. 

Corollary 5.2. According to our notation, we have, for T, X G C(y) and 
A,FeM„(C).- 

m 

\\K^{T) - K^{T + X)\\< , 

k=l 

16 



\d^{A) - d^{A + Y)\ < J2Pn-k{r^.M)\\y\ 



k=l 
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